UNIQUENESS OF LOW-RANK MATRIX COMPLETION BY 
RIGIDITY THEORY 
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Abstract. The problem of completing a low-rank matrix from a subset of its entries is often 
encountered in the analysis of incomplete data sets exhibiting an underlying factor model with 
applications in collaborative filtering, computer vision and control. Most recent work had been 
focused on constructing efficient algorithms for exact or approximate recovery of the missing matrix 
entries and proving lower bounds for the number of known entries that guarantee a successful recovery 
with high probability. A related problem from both the mathematical and algorithmic point of view 
is the distance geometry problem of realizing points in a Euclidean space from a given subset of 
their pairwise distances. Rigidity theory answers basic questions regarding the uniqueness of the 
realization satisfying a given partial set of distances. We observe that basic ideas and tools of 
rigidity theory can be adapted to determine uniqueness of low-rank matrix completion, where inner 
products play the role that distances play in rigidity theory. This observation leads to an efficient 
randomized algorithm for testing both local and global unique completion. Crucial to our analysis 
is a new matrix, which we call the completion matrix, that serves as the analogue of the rigidity 
matrix. 

Key words. Low rank matrices, missing values, rigidity theory, rigid graphs, iterative methods. 
AMS subject classifications. 05C10, 05C75, 15A48 

1. Introduction. Can the missing entries of an incomplete real valued matrix 
be recovered? Clearly, a matrix can be completed in an infinite number of ways 
by replacing the missing entries with arbitrary values. In order for the completion 
question to be of any value we must restrict the matrix to belong to a certain class of 
matrices. A popular class of matrices are the matrices of limited rank and the problem 
of completing a low-rank matrix from a subset of its entries has received a great deal of 
attention lately. The completion problem comes up naturally in a variety of settings. 
One of these is the Netflix problem [1] , where users submit rankings for only a small 
subset of movies, and one would like to infer their preference of unrated movies. The 
data matrix of all user-ratings may be approximately low-rank because it is believed 
that only a few factors contribute to an individual's preferences. The completion 
problem also arises in computer vision, in the problem of inferring three-dimensional 
structure from motion [2], as well as in many other data analysis, machine learning 
[3], control [4] and other problems that are modeled by a factor model. Numerous 
completion algorithms have been proposed over the years, see e.g., [5, 6, 7, 8, 9, and 
references therein]. Many of the algorithms relax the non-convex rank constraint 
by the convex set of semidefinite positive matrices and solve a convex optimization 
problem using semidefinite programming (SDP) [10]. Recently, using techniques from 
compressed sensing [11, 12], Candes and Recht [13] proved that if the pattern of 
missing entries is random then the minimization of the convex nuclear norm (the £i 
norm of the singular values vector) finds (with high probability) the exact completion 
of most na x n matrices of rank d as long as the number of observed entries m satisfies 
m > C (a) dn^ log n, where C{a) is some function. Even more recently, Keshavan, 
Oh, and Montanari [14, 15] improved the bound to C{a)dnlogn and also provided 
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an efficient completion algorithm. 

These fascinating recent results do not provide, however, a solution to the more 
practical case in which the pattern of missing entries is non-random. Given a spe- 
cific pattern of missing entries, extremely desirable would be an algorithm that can 
determine the uniqueness of a rank-rf matrix completion. Prior to running any of the 
numerous existing completion algorithms such as SDP it is important for the analyst 
to know if such a completion is indeed unique. 

Building on ideas from rigidity theory (see, e.g., [16]) we propose an efficient ran- 
domized algorithm that determines whether or not it is possible to uniquely complete 
an incomplete matrix to a matrix of specified rank d. Our proposed algorithm does 
not attempt to complete the matrix but only determines if a unique completion is 
possible. We introduce a new matrix, which we call the completion matrix that serves 
as the analogue of the rigidity matrix in rigidity theory. The rank of the completion 
matrix determines a property which we call infinitesimal completion. Whenever the 
completion matrix is large and sparse its rank can be efficiently determined using 
iterative methods such as LSQR [34]. As in rigidity theory, we will also make the 
distinction between local completion and global c;ompletion. The analogy between 
rigidity and completion is quite striking, and we believe that many of the results in 
rigidity theory can be usefully translated to the completion setup. Our randomized 
algorithm for testing local completion is based on a similar randomized algorithm for 
testing local rigidity that was suggested by Hendrickson [20] , whereas our randomized 
algorithm for testing global completion is based on the recent randomized global rigid- 
ity testing algorithm of Gortler, Healy, and Thurston [17] who proved a conjecture by 
Connelly [18] for the characterization of globally rigid frameworks. Due to the large 
body of existing work in rigidity theory we postpone some of the translation efforts 
to the future. 

The organization of the paper is as follows. Section 2 contains a glossary of defini- 
tions and results in rigidity theory on which our algorithms are based. In Section 3 we 
analyze the low-rank completion problem for the particular case of positive semidefi- 
nite Gram matrices and present algorithms for testing local and global completion of 
such matrices. In Section 4 the analysis is generalized to the more common comple- 
tion problem of general low-rank rectangular matrices and corresponding algorithms 
are provided. Section 5 is concerned with the combinatorial characterization of entry 
patterns that can be either locally completed or globally completed. In particular, 
we present a simple combinatorial characterization for rank-1 matrices and comment 
on the rank-2 and rank-d {d > 3) cases. In Section 6 we detail the results of ex- 
tensive numerical simulations in which we tested the performance of our algorithms 
while verifying the theoretical bounds of [13, 14, 15] for matrices with random missing 
patterns. Finally, Section 7 is a summary and discussion. 

2. Rigidity theory: basic definitions and results. Rigidity theory tries to 
answer if a given partial set of distances dij = \\pi —pj\\ between n points in uniquely 
determines the coordinates of the points pi, ... , pn up to rigid transformations (trans- 
lations, rotations, reflections). This section is a self contained but extremely selective 
and incomplete collection of basic definitions and results in rigidity theory from the 
literature (e.g., [16, 17, 19, 20, and references therein]). Readers who are unfamiliar 
with rigidity theory may wish to skip this section at first reading and use it as a 
glossary. 

A bar and joint frameworkvaW^ is an undirected graph G = {V,E) {\V\ ~ n, \E\ = 
m) and a configuration p which assigns a point p, in M'' to each vertex i of the graph. 
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The edges of the graph correspond to distance constraints, that is, Q E iS there 
is a bar of length dij between pi and pj. Consider a motion of the configuration 
with pi{t) being the displacement vector of vertex i at time t. Any smooth motion 
that instantaneously preserves the distance dij must satisfy ^\\pi — PjW^ = for all 
e E. Denoting the instantaneous velocity of the i-th point by Pi, it follows that 

{Pi -Pj)- {Pi -Pj)= 0, for all e E. (2.1) 

Given a framework G{p) in K'^, a solution p = [Pi P2 ' ' ' PnV with p; in M.'^ to the 
system of linear equations (2.1) is called an infinitesimal motion. This linear system 
consisting of m equations in dn unknowns can be brought together as Rg{p)p = 0, 
where Rg{p) is the so called m x dn rigidity matrix. 

Note that for every skew-symmetric d x d matrix A (with = —A) and for 
every b G R'^ we have that Pi = Api + 6 is an infinitesimal motion, where A ac- 
counts for some orthogonal transformation and b aecoimts for some translation. Such 
infinitesimal motions are called trivial because they are the derivative of rigid trans- 
formations. A framework G{p) is infinitesimally rigid if all infinitesimal motions are 
trivial, and infinitesimally flexible otherwise. Observe that the trivial infinitesimal 
motions span a d{d+ l)/2 dimensional subspace of M''", combining the d degrees of 
freedom of translations with the d{d — l)/2 degrees of freedom of orthogonal trans- 
formations. Therefore, the dimensionality of the null space of the rigidity matrix 
of a given framework determines if it is infinitesimally rigid or infinitesimally flexi- 
ble: if dimnull(i?G(p)) > d{d + l)/2 then G{p) is infinitesimally flexible, otherwise 
dimnull(i?G(?')) = d{d + l)/2 and G{p) is infinitesimally rigid. 

A framework G{p) is said to be locally rigid if there exists a neighborhood U of 
G{p) such that G{p) is the only framework in U with the same set of edge lengths, 
up to rigid transformations. In other words, there is no continuous deformation that 
preserves the edge lengths. 

A configuration is generic if the coordinates do not satisfy any non-zero polyno- 
mial equation with integer coefficients (or equivalently algebraic coefficients). Generic 
configurations are not an open set of configurations in M''", but they do form a dense 
set of full measure. 

The following rigidity predictor was introduced by Gluck [21] and extensively used 
in Asimow and Roth [22]: 

Theorem 2.1 (Gluck [21], Asimow and Roth [22]). // a generic framework G{p) 

of a graph G with d+\ or more vertices is locally rigid in , then it is infinitesimally 
rigid; otherwise dim null (i?G(p)) > d{d + l)/2. 

Since the dimension of the null space of the rigidity matrix is the same at every 
generic point, local rigidity in is a generic property. That is, either all generic 
frameworks of the graph G are locally rigid, or none of them are. This is a condition 
for generic local rigidity in M'' which can be considered as a property of the graph G. 

Hendrickson [20] observed that generic local rigidity can therefore be tested ef- 
ficiently in any dimension using a randomized algorithm: simply randomize the dis- 
placement vectors pi,. . . ,pn while ignoring the specific distance constraints that they 
have to satisfy, construct the rigidity matrix corresponding to the framework of the 
original graph with the randomized points and check its rank. With probability one, 
the rank of the rigidity matrix that corresponds to the unknown true displacement 
vectors equals the rank of the randomized rigidity matrix. A similar randomized 
algorithm for local generic rigidity was described in [17, Algorithm 3.2]. 

Since generic local rigidity is a combinatorial property of the graph, it is natural 
to search for a combinatorial characterization of such graphs. Such a combinatorial 
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characterization exists for rigidity in tlio plane (d = 2) . The total number of degrees of 
freedom for n points in the plane is 2n. How many distance constraints are necessary 
to limit a framework to having only the trivial motions? Or equivalently, how many 
edges are necessary for a graph to be rigid? Each edge can remove a single degree 
of freedom. Rotations and translations will always be possible, so at least 2n — 3 
edges are necessary for a graph to be rigid. For example, a graph with n = 3 and 

= 2n — 3 = 3 edges is the triangle which is rigid. Similarly, a graph with n = 4 
and \E\ = 2n — 3 = 5 is K4 minus one edge which is also locally rigid. However, 
the graph on n = 5 vertices consisting of K4 plus one dangling node has 2n — 3 = 7 
edges but it is not rigid. Such edge counting considerations had already been made 
by Maxwell [23] in the 19th century. Laman [24] was the first to prove the precise 
combinatorial characterization of rigid frameworks in the plane: 

A framework is minimally rigid, if it is infinitesimally flexible once an edge is 
removed. A framework is redundantly rigid, if it is infinitesimally rigid upon the 
removal of any single edge. 

Theorem 2.2 (Laman [24]). A graph with n vertices is generically minimally 
rigid, in 2D if and only if it has 2n — 3 edges and no subgraph of n' vertices has more 
than 2n' — 3 edges. A graph is generically rigid if it contains a Laman graph with n 
vertices. 

In other words, Laman condition for minimally rigid graphs says that the graph 
need to have at least 2n — 3 "well-distributed" edges. Generic rigidity is a property of 
the graph connectivity, not the geometry. The pebble game algorithm of Hendrickson 
and Jacobs [25] applies Laman's theorem to determine generic local rigidity of a given 
graph in at most 0{n?) steps. Laman graphs (i.e., generic minimally rigid graphs) 
are an instance of tight sparse graphs. A graph with n vertices and m edges is said 
to be {k,l)-sparse if every subset of n' < n vertices spans at most kn' — I edges. If, 
furthermore, m = kn — I, the graph is called tight (see, e.g, [26]). Thus the (2,3)- 
sparse tight graphs are the Laman graphs. Unfortunately, an exact combinatorial 
characterization of locally generic rigid graphs is currently not available in higher 
dimensions {d > 3). The "edge-counting" condition is necessary but not sufficient and 
it is a long standing open problem what is the combinatorial condition for rigidity in 
3D. 

Local generic rigidity does not imply unique realization of the framework. For 
example, consider the 2£'-rigid graph with n = 4 vertices and m = 5 edges consisting 
of two triangles that can be folded with respect to their joint edge. A framework G{p) 
is globally rigid in M.'^ if all frameworks G{q) in M.'^ which are G'(p)-equivalent (have 
all bars the same length as G{p)) are congruent to G{p) (that is, they are related by 
a rigid transformation). 

Hendrickson proved two key necessary conditions for global rigidity of a framework 
at a generic configuration: 

Theorem 2.3 (Hendrickson [20]). If a framework G{p), other than a simplex, is 
globally rigid for a generic configuration p in M'' then: 

• The graph G is vertex {d + \)-connected; 

• The framework G{p) is redundantly rigid, in the sense that removing any one 
edge leaves a gra,ph which is infinitesimally rigid. 

A graph G is generically globally rigid in R'' if G{p) is globally rigid at all generic 
configurations p [27, 18]. Only recently it was demonstrated that global rigidity is a 
generic property in this sense for graphs in each dimension [18, 17]. The conditions 
of Hendrickson as stated in Theorem 2.3 are necessary for generic global rigidity. 

4 



They are also sufficient on the fine, and in the plane [28]. However, by a result of 
Connelly [27], iiTs 5 in 3-space is generically redundantly rigid and 5-connected but is 
not generically globally rigid. 

The critical technique used for proving global rigidity of frameworks uses stress 
matrices. A stress is an assignment of scalars Wij to the edges such that for each 
i e V 

^ij{Pi-Pj)=0. (2.2) 

Alternatively, a sclf-strcss is a vector in the left null space of the rigidity matrix: 
Rg{p)^w = 0. a stress vector can be rearranged into an n x n symmetric matrix J7, 
known as the stress matrix, such that for i ^ j, the (i, j) entry of f2 is fiy = —u>ij, and 
the diagonal entries for {i, i) arc ^lu = ujij. Note that all row and column sums 

are now zero from which it follows that the all-ones vector (11 • • • 1)^ is in the null 
space of ft as well as each of the coordinate vectors of the configuration p. Therefore, 
for generic configurations the rank of the stress matrix is at most n — {d + 1). The 
key connection for global rigidity are the following pair of results: 

Theorem 2.4 (Connelly [18]). If p is a generic configuration in W^, such that 
there is an equilibrium stress, where the rank of the associated stress matrix Cl is 
n — {d + 1), then G{p) is globally rigid in . 

Theorem 2.5 (Gortler, Healy, and Thurston [17]). Suppose that p is a generic 
configuration in M*^, such that G{p) is globally rigid in W^. Then either G{p) is a 
simplex or there is an equilibrium stress where the rank of the associated stress matrix 
Q is n — {d+1). 

Based on their theorem, Gortler, Healy and Thurston also provided a randomized 
polynomial algorithm for checking generic global rigidity of a graph [17, Algorithm 
3.3]. If the graph is generically local rigid then their algorithm picks a random stress 
vector of the left null space of the rigidity matrix, converts it into a stress matrix 
and computes the rank of the stress matrix which is compared with n — {d + 1) to 
determine generic global rigidity. 

Rigidity properties of random Erdos-Renyi G{n,j3) graphs where each edge is 
chosen with probability /3 have been recently analyzed for the two dimensional case: 

Theorem 2.6 (Jackson, Servatius, and Servatius [29]). Let G = G{n,(3), where 
(3 = (logn + fcloglogn + w{n))/n, and lim„^oo w{n) = +00. 

• If k = 2 then G is asymptotically almost surely (a.a.s) generically locally 
rigid. 

• If k = '6 then G is a.a.s. generically globally rigid. 

The bounds on p given in Theorem 2.6 are best possible in the sense that G = 
G{n,P) and /3 = (logn + fc log logn + c)/n for any constant c, then G docs not a.a.s. 
have minimum degree at least k. The emergence of large rigid components was also 
studied by Theran in [30]. 

Supplied with this rigidity theory background, we are ready to analyze the low- 
rank matrix completion problem. 

3. Gram matrices. Wc start by analyzing the completion problem of low-rank 
positive scmidefinitc Gram matrices with missing entries. We make extensive use of 
the terminology and results summarized in the glossary Section 2 which the reader is 
advised to consult whenever felt needed. 
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For a collection of n vectors pi,p2, ■ ■ ■ ,Pn € M"^ there corresponds an n x n Gram 
matrix J of rank d whose entries are given by the inner products 

Jij=Pi-Pj, i,j = l,...,n. (3.1) 

An alternative way of writing J is through its Cholesky decomposition J — P, 
where P is •<% d x n matrix given by P = [ pi p2 ■ ■ ■ Pn ] , from which it is 
clear that rank( J) = d. If J is fully observed (no missing entries) then the Cholesky 
decomposition of J reveals P up to a d x orthogonal matrix O (OO^ — I)i as J = 
P^P = (OP)^ {OP). Now, suppose that only a few of the entries of J are observed 
by the analyst. The symmetry of the matrix J implies that the set of observed entries 
defines an undirected graph G = {V,E) with n vertices where e £^ is an edge 
iff the entry Jij is observed. The graph may include self loop edges of the form {i, i) 
corresponding to observed diagonal elements Ju (note that rigidity graphs have no 
self loops as the distance from a point to itself is not informative). For an incomplete 
Gram matrix J with an observed pattern that is given by the graph G, we would 
like to know if it is possible to uniquely complete the missing entries of J so that the 
resulting completed matrix is of rank d. 

For example, consider the three planar points 

P.^(;),..^(^),.3^(^):P^(; I I). (3.) 
whose corresponding 3-by-3 Gram matrix J is of rank 2 

J = P'^P =12 5 8 1. (3.3) 



The following three different missing patterns demonstrate that a matrix may either 
have a unique completion, a finite number of possible completions, or an infinite 
number of possible completions: 







(3.4) 



For the left matrix, the missing diagonal element is uniquely determined by the fact 
that det J = 0. For the middle matrix, the vanishing determinant constraint is a 
quadratic equation in the missing entry and there are two different possible comple- 
tions (the reader may check that J13 = J31 = 3.4 is a valid completion). For the right 
matrix, the vanishing determinant constraint is a single equation for the two unknown 
diagonal elements, and so there are infinite number of possible completions. We want 
to go beyond 3-by-3 matrices and develop techniques for the analysis of much larger 
matrices with arbitrary patterns of missing entries. 

3.1. The completion matrix and local completion. We now adopt rigidity 
theory to the matrix completion problem. We start by considering motions Pi{t) that 
preserve the inner products Jij = Pi ■ Pj for all G E. Difi^erentiating (3.1) with 
respect to t yields the set of m = \E\ linear equations for the unknown velocities 



Pi ■ Pj + Pj ■Pi = 0, for all e E. 
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(3.5) 



This linear system can be brought together as Cq{p)p = 0, where Cc{p) is an m x dn 
coefficient matrix which wc call the completion matrix. The completion matrix is 
sparse as it has only 2d non-zero elements per row. The locations of the non-zero 
entries are solely determined by the graph G, while their values are determined by the 
particular realization p. The solution space of (3.5) is at least d{d— l)/2 dimensional, 
due to orthogonal transformations that preserve inner products. Indeed, substituting 
into (3.5) the ansatz pi = Api (for alH = 1, . . . ,n) with A being a constant d x d 
matrix yields pJ(A + A'^)pj = 0. Therefore, any choice of a skcw-symmcitric matrix 
A = —A^ leads to a possible solution. We refer to these as the trivial infinitesimal 
motions. The number of trivial degrees of freedom in the completion problem is 
d{d — l)/2 which differs from its rigidity theory counterpart, because translations 
preserve distances but not inner products. 

The rank of the completion matrix will help us determine if a unique completion 
of the Gram matrix J is possible. Indeed, if 

dimnull(CG(p)) > d{d - l)/2, (3.6) 

that is, if the dimensionality of the null space of Cg{p) is greater than d{d — l)/2, 
then there exist non-trivial solutions to (3.5). In other words, there are non-trivial 
infinitesimal flexible motions that preserve the inner products. The rank of the com- 
pletion matrix thus determines if the framework is infinitesimally completable. The 
counterpart of Asimow-Roth theorem would imply that there exists a non-trivial 
transformation that preserves the inner products and that the matrix is not generi- 
cally locally completable. Since almost all completion matrices for a given graph have 
the same rank, generic local completion is a property of the graph itself, and wc do 
not need any advance knowledge of the realization of the matrix that we are trying 
to complete. Instead, we can simply construct a completion matrix from a randomly 
chosen realization. With probability one, the dimensionality of the null space of the 
randomized completion matrix will be the same as that of the completion matrix of 
the true realization, and this rank will determine if the Gram matrix is generically 
locally completable or not. The resulting randomized algorithm for testing local com- 
pletion is along the same lines of the randomized algorithms for testing local rigidity 
[20, 17]: 



Algorithm 1 Local completion of n x n rank-rf Gram matrices 
Require: Graph G = (V, E) with n vertices and m edges corresponding to known 
matrix entries (self loops are possible). 
1: Randomize a realization pi, . . . ,p„ in R'^. 

2: Construct the sparse completion matrix Cq{p) of size m x dn. 
3: Check if there is a non-trivial infinitesimal motion p satisfying Cg{p)p = 0. 
4: If a non-trivial infinitesimal motion exists then G cannot be locally completable, 
otherwise G is locally completable. 



In order for Algorithm 1 to be feasible for large-scale problems, the approach 
sketched above requires a fast method to determine the existence of a non-trivial 
infinitesimal motion, which is equivalent to checking that the rank of the completion 
matrix satisfies rank(CG(p)) < dn — d{d — l)/2. This is not a straightforward check 
from the numerical linear algebra point of view. Note that the rank of a matrix can be 
determined only up to some numerical tolerance (like machine precision), because the 
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matrix may have arbitrarily small non-zero singular values. The full singular value 
decomposition (SVD) is the most reliable way to eompute the rank of the completion 
matrix (e.g., using MATLAB's rank function), but is also the most time consuming 
and is computationally prohibitive for large matrices. The completion matrix is often 
sparse, in which case, sparse LU, sparse QR and rank-revealing factorizations [31, 32. 
and references within] are much more efficient. However, due to non-zero fill-ins, 
such methods quickly run out of memory for large scale problems. Our numerical 
experimentation with Gotsman and Toledo's sparse LU MATLAB function nulls [31] 
and Davis' SuiteSparseQR MATLAB library and spqr function [32] encountered some 
memory issues for n > 6000. Therefore, for large-scale sparse completion matrices we 
use iterative methods that converge fast and do not have special storage requirements. 
The iterative procedure has several steps: 

1. Use different choices of skew-symmetric d x d matrices A to construct d{d — 
l)/2 linearly independent trivial infinitesimal motions (recall that trivial mo- 
tions are given by pi = Api, i = 1, . . . , n), and store the trivial motions in a 
dn X d{d — l)/2 matrix T. 

2. Compute the QR factorization of T = QR (see, e.g., [33]) such that the 
columns of the dn x d{d — l)/2 matrix Q form an orthogonal basis for the 
subspace of trivial motions, i.e., the two column spaces are the same col(<5) = 
col(T) and Q'^Q = Id(d-i)/2- 

3. Randomize a unit size vector h E M'*" in the orthogonal subspace of trivial 
motions, b G col(<5)^- This is performed by randomizing a vector v € M''" 
with i.i.d standard Gaussian entries {vi ~ Af{0, 1)), projecting v onto the 
orthogonal subspace using w = {I-QQ'^)v (the matrix QQ'^ is never formed) , 
and normalizing h = w/'^w'^. It is easy to check that Q^b = and that b has 
the desired normal distribution. 

4. Attempt solving the linear system Ccipi^x = b for the unknown x using 
an iterative method such as LSQR [34] that minimizes the sum of squares 
residual. The linear system may or may not have a solution. Numerically, 
a tolerance parameter tol must be supplied to the LSQR procedure. Set the 
tolerance parameter to be tol = en~^/^, with a small e, e.g., e = 10"**. If 
the residual cannot be made smaller then tol then conclude that the linear 
system has no solution. In such a case b ^ co\{Cg{p)'^) and by the hm- 
damental theorem of linear algebra it follows that the projection of b onto 
null(CG(p)) is non-zero. Since b is orthogonal to all trivial motions, it follows 
that iml\(CG{p)) contains a non-trivial infinitesimal motion and the matrix is 
not locally completable. On the other hand, if the linear system Cg{p)x = b 
has a solution in the sense that the residual is smaller than en~^/^ then the 
projection of b on nul^Ccd?)) smaller than £n~'^/'^ . If a non-trivial infinites- 
imal motion p exists, then the projection of b onto it is normally distributed 
with zero mean and variance n~^, that is 6^p/||p|| ^ J\f{Q,n~^). Therefore, 

2e 

with probability at least 1 = all infinitesimal motions are trivial. 



The LSQR procedure consists of applying the sparse completion matrix Cq and its 
transpose Cq to vectors with no special need for storage. The number of non-zero 
entries in the completion matrix is 2dm which is also the computational cost of apply- 
ing it to vectors. The number of LSQR iterations depends on the non-zero singular 
values and in particular the ratio of the largest singular value and the smallest non- 
zero singular value (condition number). Arbitrarily small singular values may cause 
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our iterative algorithm with its preset tolerance to fail. In practice, however, at least 
for moderate values of n, the full SVD revealed that such small singular values are 
rare. 

We conclude this section by general remarks on the iterative procedure described 
above. First, note that the same iterative procedure can be used to determine lo- 
cal rigidity of bar and joint frameworks, and perhaps it can also be useful in other 
applications where existence of non-trivial null space vector is sought to be deter- 
mined. Second, iterative methods can be often accelerated by a proper choice of 
a preconditioner matrix. This leads to the interesting question of designing a suit- 
able preconditioner for completion and rigidity matrices, which we defer for future 
investigation. 

3.2. Global completion and stress matrices. Generically local completion 
of a framework means that the realization cannot be continuously deformed while 
satisfying the inner product constraints. However, as the middle matrix in example 
(3.4) shows, local completion does not exclude the possibility of having a non-trivial 
discontinuous deformation that satisfies the inner product constraints, where by non- 
trivial we mean that the deformation is not an orthogonal transformation. We say 
that the framework is globally completable if the only deformations that preserve the 
inner products are the trivial orthogonal transformations (rotations and reflections). 
While local completion allows for a finite number of different completions, global 
completion is a stronger property that certifies that completion is unique. 

A completion stress u> for a framework is an assignment of weights u>ij on the 
edges of the graph such that for every vertex i gV 



Equivalently, a completion stress a; is a vector in the left null space of the completion 

matrix Cg{p), i-c, Cg{p)'^uj = 0. A stress matrix J7 is a symmetric n x n matrix 
obtained by the following rearrangement of the completion stress vector entries: fijj = 
Wij for e E, and flij = for ^ E. 

It follows from (3.7) that if is a stress for the framework of pi, . . . ,pn then 
it is also a stress for the framework of Api, . . . ,Apn, where A is any d x d linear 
transformation. In other words, the d coordinate vectors and their linear combinations 
are in the null space of the stress matrix CI and dimnull(ri) > d. Gortler, Healy, and 
Thurston [17] suggested a randomized algorithm for testing global rigidity based on 
Theorems 2.4 and 2.5 that relate stress matrices and global rigidity. Building on 
these Theorems and their randomized algorithm, we propose Algorithm 2, which is 
a randomized algorithm for testing global completion. Algorithm 2 uses iterative 
methods in order to insure its scalability to large scale matrices. 

In stage (4) of Algorithm 2 we use LSQR, which when initialized with a random 
starting vector converges to a random left null space solution, rather than to the zero 
vector. Here we use LSQR with a very small tolerance as we are guaranteed the 
existence of a non-trivial stress. 

In stage (6) we again apply LSQR, this time similarly to the way it is applied in 
the local completion case (Algorithm 1). Specifically, we first find a random vector b 
which is perpendicular to the subspace of coordinate vectors and then we try to solve 
ilx = b. Here fl is symmetric (compared to Cq)- For moderate scale problems (e.g., 
n < 5000) we use sparse QR (SPQR) to compute the rank of CI as it runs faster than 
LSQR, but cannot handle much larger values of n due to memory problems (fill-ins). 




(3.7) 



9 



Algorithm 2 Global completion oi n x n rank-d Gram matrices 

Require: Graph G = {V, E) with n vertices and m edges corresponding to known 

matrix entries (self loops are possible). 
1; Check local completion using Algorithm 1. Proceed only if framework is locally 

completable. 
2: Randomize a realization pi, . . . ,p„ in W^. 
3: Construct the sparse completion matrix Cg{p) of size m x dn. 
4: Compute a random completion stress vector uj in the left null space of Cg{p) 

satisfying Cg{p)^<^ = 0. 
5: Rearrange u into a completion stress matrix O. 

6; Check if the null space of CI contains vectors which are not linear combinations of 

the d coordinate vectors. 
7: If such null space vectors exist (i.e., if dimnull(ri) > d) then G is not globally 

completable, otherwise G is globally completable. 



4. General rectangular low rank matrices. A general ni x n2 rank-d matrix 
X can be written as A = UV'^ where U is rii x d and V is n2 x d given hy U = 
[ ui U2 ■ ■ ■ Wni ] and F = [ ui V2 ■ ■ ■ ] , where the m + n2 vectors 

ui , . . . , ,vi,. . . , are in W^. Entries of X are inner products of these vectors 



The observed entries Ay define a bipartite graph G = (V, E) with m + n2 vertices as 
we never observe inner products of the form m ■ Ui' or vj ■ Vji. Differentiation of (4.1) 
with respect to t yields the set of linear equations 



for the unknown velocities iii and Vj. The corresponding completion matrix Cg{u,v) 
has m rows and d{n\ + 712) columns, but only 2d non-zero elements per row. 

The decomposition A = UV'^ is not unique: if W is an invertible d x d matrix 
then A = UwV^ with Uw = UW and Vw = ViW^^)'^. It follows that there are 
d"^ degrees of freedom in choosing W, because the general linear group GL{d,R) of 
d X d invertible matrices is a Lie group over R of dimension d^. Indeed, substituting 
in (4.2) the ansatz iii = Aui (for i ~ 1,. . . , ni) and Vj — Bvj (for j — 1, . . . , 712) gives 
uJ{B + A'^)vj = 0, which is trivially satisfied whenever B = —A^. These are the 
trivial infinitesimal motions and they span a subspace of dimension d^. 

Similarly to local rigidity and local completion of Gram matrices, a condition for 
local completion for general rectangular matrices is dimnull(CG(M, w)) = d^. If the 
dimension of the null space of the completion matrix is greater than d^ then there are 
non-trivial deformations that preserve all observed elements of the matrix, where a 
trivial deformation is any invertible linear transformation of M*^. The local completion 
testing algorithm for general rectangular matrices is given in Algorithm 3. 

The implementation of the steps in Algorithm 3 is very similar to the implemen- 
tation of the steps in Algorithm 1 for testing local completion of Gram matrices. 

As in the Gram case, local completion does not imply global completion. A stress 
Lu for the general rectangular matrix case is an assignment of weights LUij on the edges 
of the bipartite graph that satisfy 



Xij — Ui • Vj . 



(4.1) 



Ui ■ Vj + Vj • itj = 0, {i, j) e E 



(4.2) 




for alH = 1, . . . 



,ni 



(4.3) 



3- {hj)eE 
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Algorithm 3 Local completion of m x n2 rank-d matrices 

Require: Bipartite graph G = {V, E) with n\+n2 vertices and m edges corresponding 

to known matrix entries. 
1: Randomize a realization ui, . . . , Um and iii, . . . , in I^''- 
2: Construct the sparse completion matrix Cg{u,v) of size m x d(ni + 712). 
3: Check if there is a non-trivial infinitesimal motion p satisfying Cg{p)p = 0, where 

there are trivial motions. 
4: If a non-trivial infinitesimal motion exists then G cannot be locally completable, 

otherwise G is locally completable. 



and 

u)ijUi = 0, for all j = 1, . . . , n2. (4.4) 

i:{i,j)eE 

The stress lo is the left null space of the completion matrix, i.e., Cg{u, vY'lo = 0. 
The stress weights can be viewed as the entries of an m x n2 matrix f2 that satisfies 
= and U^U = 0. The stress matrix is the (ni + 712) x (m + 722) symmetric 

matrix O defined via 



The stress matrix f2 satisfies 



"(0 {^)=0' (4-6) 

from which it follows that diinnull(f7) > 2d. Following the randomized algorithms for 
global rigidity and global completion of Gram matrices, Algorithm 4 is a randomized 
algorithm for testing global completion of rectangular matrices. 

Algorithm 4 Global completion of rii x n2 rank-c? matrices 

Require: Bipartite graph G = (V, E) with ni+n2 vertices and m edges corresponding 
to known matrix entries. 
1: Check local completion using Algorithm 3. Proceed only if framework is locally 
completable. 

2: Randomize a realization Ui, . . . , Um and vi, . . . , Vn^ in 

3: Construct the sparse completion matrix Cg{u,v) of size m x d{ni + 712). 

4: Compute a random completion stress vector uj in the left null space of Cciujv) 

satisfying Cg{u, v)'^w = 0. 
5: Rearrange cu into an (ni + 7x2) x (r?,i + 77,2) symmetric completion stress matrix fl. 
6: Check if the null space of O contains a vector outside the column space of 

^ ^ (cquivalently, check if the null space of Q contains more than 2d 



V 

linearly independent vectors). 

If dimnull(O) > 2d then G is not globally completable, otherwise G is globally 
completable. 
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5. Combinatorial approach for local and global completion. In the pre- 
vious sections we observed that the rank of the completion and the stress matri- 
ces can determine generic local and global rank-d completion properties of a given 
graph. These observations led to practical algorithms for property testing, but per- 
haps there is a simple combinatorial characterization of locally and/or globally com- 
putable graphs? In rigidity theory, locally and globally rigid graphs have a simple 
combinatorial characterization in one and two dimensions (see Theorems 2.2 and 2.3 
by Laman and Hcndrickson). In higher dimensions, however, such combinatorial 
characterizations are still missing, and only necessary conditions are available. We 
therefore believe that exact combinatorial characterization of local and global com- 
pletion of rank-rf matrices for d > 3 is currently out of reach, and focus our attention 
to rank-1 and rank-2 matrices and to finding only necessary conditions for d > 3. We 
begin by observing some properties of locally completable graphs. 

Proposition 5.1. In any Gram locally completable rank-d matrix J of size nxn 
with n> d, one can delete entries until the resulting matrix is locally completable and 
has exactly dn — entries. 

Proof. The completion matrix of the system of equations (3.5) pi ■ pj +Pj -Pi = 
for all G E must have rank dn — ^('^~^) , and thus one can drop linearly dependent 
equations until only dn — equations remain. □ 

Proposition 5.2. Any Gram locally com,pletable rank-d matrix J with \E(Gj) \ = 
dn — lias the property that for any n! x n! submatrix J' of J, where d < n' < n, 

it holds true that \E{Gj>)\ < dn' - 

Proof. For every {i,j) G E{Gj) there corresponds an equation pi -pj +pj -pi = 0. 
Given our interpretation of local completion and Proposition 5.1, these equations are 
linearly independent. If for some n' x n' submatrix J' of J, with n' > 1 we would 
have that the number of edges \E{Gji)\ > dn' — then by the same Proposition 

5.1 there would be dependence among the corresponding rfn' — ^^^^ equations, which 
is a contradiction. □ 

The result above implies that every locally completable Gram matrix contains an 
underlying graph that spans all vertices which is {d, ^^^^^-!^)-tight sparse. It is natural 

to ask whether any {d, ^^^^)-tight sparse graph is Gram locally completable. The 

answer to this question turns out to be false even in one dimension, that is, not every 
(l,0)-tight sparse graph is Gram locally completable for d = 1. 

Proposition 5.3. A graph G is minimally Gram locally completable in one 
dimension if and only if each connected component of G is a tree plus one edge that 
contains an odd cycle. 

Proof. First, suppose G = {V, E) is minimally Gram locally completable for 
d = 1. Proposition 5.1 implies that G has no redundant edges so \E{G)\ = \V{G)\. 
Moreover, Proposition 5.2 implies that each connected component H of G satisfies 
\E{H)\ = |l/(iJ)|, from which it follows that each connected component is a tree plus 
one edge. We show that the cycle formed by the extra edge must be of odd length. 
Let L be the length of the cycle and w.l.o.g let its vertices be {1, . . . , L} with the 
corresponding framework points pi, . . . ,pl. The linear system (3.5) attached to the 
cycle edges is given by 



PiPi+i + Pi+iPi = 0, i=l,...,L, 
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(5.1) 



(with the convention that L + 1 is 1). The system (5.1) results in the coefhcient matrix 



/ P2 Pi \ 
P3 P2 

Cl= o'-. ■•• 

pL-2 

PL PL-1 

\pl Pi J 
Expanding by the first column, we get that 

L 

det CL=P2l[pi + i-lf+'pL n = [1 + (-1)"^^'] Up* 

i^2 i^L i=l 

For L even the determinant vanishes, from which it follows that there is a linear 
dependence (redundancy) among the equations and G cannot be minimally locally 
completablc. Therefore, the length of the cycle must be odd. 

Conversely, if each connected component of G is a tree plus one edge that forms an 
odd cycle, then from det (7/, ^ it follows that the only solution to (5.1) is the trivial 
one: pi=P2 — PL— From the connectivity of the connected component 

we get that all velocities must vanish, that is, the only solution to Cg{p)p = is 
p = and G is locally completable. Since each connected component is a tree plus 
one edge it follows that \E{G)\ = \ V{G)\ which means that G is also minimally locally 
completable. □ 

We now turn to the combinatorial characterization of global completion for Gram 

matrices in one dimension. Note that the inner products accessible to the analyst are 
simply products of the form pipj = Jij for € E. Taking the logarithm of the 

modulus gives the linear system 

gi + gj =log|Jy|, (t,j)GE, (5.2) 

where qi = log \pi \ . This linear system has much resemblance with the linear system 
(3.5) of Cg{p)'P = 0. Indeed, by substituting = p2 = • • • = = 1 in Cg{p) the 
two coefficient matrices of (3.5) and (5.2) are the same. The only difference between 
to the systems is that (5.2) is non-homogenous. Therefore, by following the steps 
of the proof of Proposition 5.3 it follows that if G is minimally locally completable 
then the system (5.2) has a unique solution. That is, if each connected component 
of G is a tree plus one edge that forms an odd cycle, then all the |pi|'s are uniquely 
determined. This leaves only the signs of the p'^s undetermined. Clearly, if G has 
more than one connected component then the relative sign between coordinates of 
different components cannot be determined. Therefore, a globally completable graph 
must be connected. On the other hand, if G is a single tree plus an edge that forms an 
odd cycle then by similar considerations all bit signs 5j = (1 — s\gx\pi)/2 € {0, 1} are 
determined up to overall negation (reflection), because they satisfy a similar linear 
system over Z2 

bi e hj = (1 - sign(Jy ))/2, (i, j) e E. (5.3) 

This is summarized in the following proposition: 

Proposition 5.4. A graph is minimally Gram globally completable in one di- 
mension if and only if it is a tree plus an edge that forms an odd cycle. 
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We now give the combinatorial characterization of local and global completion for 

the case of a general rectangular rank-1 matrices. The proofs are very similar to the 
Gram case and are therefore omitted. The the only differences being the number of 
degrees of freedom {cf instead of d{d— l)/2, which for d = 1 are 1 and 0, respectively) 
and the fact that the underlying graph is bipartite. 

Proposition 5.5. A rectangular graph is minimally locally completable in one 
dimension if and only if it is a forest ( a disjoint union of trees, or equivalently, a 
(l,l)-tight sparse bipartite graph). 

Proposition 5.6. A rectangular graph is minimally globally completable in one 
dimension if and only if it is a tree. 

We note that the conditions for local and global completion in one dimension 
are much weaker than the condition for local and global rigidity in one dimension, 
which are connectedness and 2-connectedness, respectively. Laman theorem for two- 
dimensional rigidity leads us to speculate that the combinatorial characterization of 
Gram and rectangular rank-2 matrices will perhaps involve (2, l)-sparse graphs and 
bipartite (2,4)-sparse graphs. However, we currently postpone the investigation of 
this interesting question. 

6. Numerical Simulations. To illustrate the applicability of the above algo- 
rithms for testing low rank matrix completion in practice, we present the outcomes of 
several numerical experiments for both Gram and general rectangular rank-rf matri- 
ces. Let us first investigate the case when J is a Gram matrix of size nx n. We apply 
the local completion Algorithm 1 to test the local completion property of random 
graphs where each edge (including self loops) is chosen independently with probabil- 
ity /?, such that the expected number of edges is E[m] ~ The conditional 
probability f{n, d, (5) for an n x n rank-d Gram matrix to be locally completable 

/(n, d, (3) = Pr{G is Gram nx n rank-d locally completable | (3} (6.1) 

is a monotonic function of (3. We define the threshold value /?* (n, d) as the value of (3 
for which f{n,d,f3*) = 1/2. The theoretical bound of Candes and Recht [13] implies 
(3*{n,d) - C(rf)n-o-«logn (CR), while that of Keshavan, Oh, and Montanari [14, 15] 
gives /3*(n, d) ^ C(d)n~^ logn (KOM) for large n. 

We now describe the numerical simulation and estimation procedure for the 
threshold values. The goal is to infer the asymptotic behavior of /3*{n,d) for large 
values of n. For small values of n the running time of the completion Algorithm 1 
is not an issue and it is possible to perform an exhaustive search for the threshold 
value. However, for large values of n (e.g., n = 20000) an exhaustive search is too 
time consuming. 

The way we choose to accelerate the search is by using logistic regression. Suppose 
that after the {i — l)'th iteration we were able to estimate the threshold value for 
Ui-i X Ui-i matrices, and now we want to find the threshold for larger matrices of size 
Ui X Ui with Ui > Ui-i. From the previous threshold estimate (3* (n^-i , d) we can easily 
guess a reasonable upper bound /3f such that with probabihty one f3*{ni, d) < (3f (e.g., 
|3^ = (3* {ni-i, d), because f3* is decreasing with n). Starting from the upper bound 
f3 = f3]^ we decrease f3 in small steps until we encounter enough matrices that are not 
completable anymore (say until we observe 20 consecutive non-completable matrices) . 
This gives us a rough confidence interval for (3* . We then sub-sample this interval to 
get a more accurate estimation of the threshold value by collecting more /3's and their 
corresponding binary responses y G {0, 1}, where y — 1 ii the matrix is completable, 
and y = otherwise. We perform a binomial logistic regression in order to estimate 
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numerically the approximate value of [3* . Logistic regression is a model frequently 
used in statistics for prediction of the probability of occurrence of an event, by fitting 
data to a logistic curve. The logistic function /(/3) models the conditional probability 
(6.1) by 

Pr{2;= 11/3} «/(/?)= ^ 



l + e-"*(/3-/3*)^ 



where (3* and a* are parameters to be estimated from the set of samples of the 
explanatory variable (i and the corresponding binary responses y. We typically used 
a total of about 120 (/?, y) sample pairs for the logistic regression (80 samples to find 
the lower bound, and another 40 samples to improve the confidence intervals for the 
estimate) . We performed similar searches and logistic regressions to find the threshold 
value for global completion of Gram matrices, as well as local and global completion 
of rectangular matrices. 

Figure 6.1 is a log-log plot of the threshold (3* against n, for rank-d Gram matrices 
(left) and rectangular matrices (right), with d = 2,3,4. For "rectangular" matrices 
we chose for simplicity rii = n2 = n. The dotted curves that appear in green are the 
CR bounds, the blue dashed curves represent global completion, while the remaining 
three curves denote local completion. It is interesting to note that both in the Gram 
case and in the rectangular case, the global completion curves for dimension d coincide 
with the local completion curves for dimension d+ 1 . This can perhaps be explained by 
the following theorem of Gortler, Healy, and Thurston [17, Theorem 1.17]: If a graph 
is generically locally rigid but not generically globally rigid in M.'^, then any generic 
framework can be connected to an incongruent framework by a path of frameworks 
in R'^+^ with constant edge lengths. For example, the graph on 4 vertices with all 
possible edges except for one {K4 minus an edge) is locally rigid in but is not 
globally rigid in K^. This graph can be realized as two triangles with a common side 
and has two possible realizations in the plane. Though it is impossible to continuously 
deform the framework in the plane, it is possible to continuously deform it by leaving 
the plane into the three dimensional space by folding one triangle on top of the other. 
We may expect a similar phenomenon in the matrix completion problem: if a graph 
is not globally rank-d completable, then it is not locally ra.nk-{d+ 1) completable. 

Both the CR and the KOM bounds can be written as (3* ^ C{d)n" \ogn or upon 
taking the logarithm as log /?* ~ a log n + log log n + log C{d) . We therefore performed 
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a simple linear regression in the Gram case with d = 2 of the form log/3*(n) = 
fli logn + 02 loglogn + 0,3 to estimate oi, 02, 03 (see Table 6.1). For local completion, 
the sampled n take values up to 100000 while for global completion up to 15000, in a 
geometric progression of rate 1.08. The coefficient a2 may be expected to be 1 (the 
coupon collector problem) and Theorem 2.6 for planar rigidity [29] may even shed 
light on the higher order corrections. The results for different rank values d= 2,3,4 
are summarized in Table 6.2. These results may be considered as a numerical evidence 
for the success of the KOM theoretical bound C(rf)nlogn. The slight deviation of 
ai + 2 from unity can be explained by the small bias introduced by the small n values. 





Local Completion 


Global Completion 




Value 


95% -conf. interval 


Value 


95% conf. interval 


ai + 2 
02 

03 


1.022 

0.63052 

0.90663 


[0.99842, 1.0456] 
[0.43626, 0.8247] 
[0.69405, 1.1192] 


0.99066 
0.79519 
0.99899 


[0.94206 1.0393] 
[0.43446 1.1559] 
[0.6394 1.3586] 


ai + 2 

02 = 1 
0.3 


0.9773 


[0.9748 0.9797] 


0.9631 


[0.95959 0.96668] 


0.5039 


[0.48295 0.5250] 


0.7954 


[0.76823 0.82258] 



Table 6.1: Linear regression for local (left column) and global (right column) rank-2 
Gram completion: log /?* = ai log n + 02 log log n + 03. 



d 


(oi + 2,02,03) 


(01+2,1,03) 


2 
3 
4 


(1.022, 0.63052 , 0.90663) 
(1.0423, 0.40053 , 1.394) 
(1.0382, 0.35039 , 1.6725) 


(0.9773, 1, 0.5039) 
(0.9636, 1, 0.78538) 
(0.95289, 1, 1.013) 



Table 6.2: Linear regression for local Gram completion for d = 2,3, 4. 



The asymptotic behavior /3* ~ C{d)dn ^logn imphes that Jl^^^ tends to a 
constant as n — > 00. Figure 6.2 shows ^j;^ against logn for different values of d 
in the Gram case (left) and in the rectangular matrix case (right) from which the 

asymptotic behavior is clear. 

Finally, in Tables 6.3 and 6.4 we list the running times in seconds for several of the 
numerical simulations. All computations were performed on a PC machine equipped 
with an Intel(R) Core(TM)2 Duo CPU 3.16GHz with 4 GB RAM. The matrices we 
considered were general "rectangular" n-by-n matrices of rank 2. We list the running 
times for different values oi f3 = ^ as a. function of /?* , where m denotes the number 
of given entries in the matrix. The algorithm often runs faster as m (alternatively, 
/?) increases, because the iterative LSQR method converges after a fewer number of 
iterations. Note that the values /3 = 0.75/3* in the first column in Table 6.3 produce 
matrices that are not locally complctablc. Similarly, in Table 6.4, all values in the 
first column were chosen such that the matrix is locally completable, but not globally 
completable. In both tables, all the values [3 = 2/3* produce matrices that are locally 
(and globally) completable. We do this to better illustrate the time difference between 
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the case when the LSQR method converges after a certain relatively small number of 
iterations, as opposed to when the residual cannot be made smaller than the threshold. 



n 


/3 


m 


T 


/3 


m 


T 




TO 


T 


101 


0.75/3* 


598 


0.07 


/3* 


796 


0.05 


2/3* 


1592 


0.06 


498 


0.75/3* 


3596 


0.24 


/3* 


4795 


0.32 


2/3* 


9590 


0.25 


1002 


0.75/3* 


7792 


0.75 


P* 


10390 


0.85 


2/3* 


20781 


0.72 


2533 


0.75/3* 


21591 


2.6 


P* 


28788 


2.3 


2/3* 


57575 


2 


5068 


0.75/3* 


45982 


10.9 


(3* 


61309 


7.3 


2/3* 


122620 


10.7 


10133 


0.75/3* 


99140 


28.6 


(3* 


132190 


12 


2/3* 


264370 


18.2 



Table 6.3: Running time T (in seconds) in the case of local completion of general 
n-by-n rectangular matrices of rank d — 2, for various values of m (number of entries 
revealed). 



7. Summary and Discussion. In this paper we made the observation that the 
rank-d matrix completion problem is tightly related to rigidity theory in M."^, with inner 
products replacing the role of distances. Many of the results in rigidity theory, both 
classical and recent, give new insights into the completion problem. In particular, we 
introduced the completion matrix and stress matrices that enable fast determination 
of generic local and global completion properties of any partially viewed matrix into 
a rank-d matrix. Our algorithms determine if a unique completion is possible without 
attempting to complete the entries of the matrix. 

Most of the results in rigidity theory translate nicely into the completion setup. 
However, due to the large body of work in rigidity theory, as well as occasional differ- 
ences between completion and rigidity, many of these results (such as generalization 
of Laman theorem to the completion setup) did not find their way into the current 
paper. Finally, we note that beyond its mathematical importance, rigidity theory is 
much useful in diverse applications such as scene analysis and localization of sensor 
networks, and some of the recent localization algorithms based on rigidity [35, 36] can 
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n 


/? 


m 


T 


P 


m 


T 


P 


m 


T 


101 


0.8/3* 


800 


0.17 


/3* 


999 


0.14 


2/3* 


1998 


0.14 


498 


0.8/3* 


4638 


1.3 


/3* 


5797 


0.9 


2/3* 


11595 


0.88 


1002 


0.9/3* 


11539 


2.2 


/3* 


12821 


3.1 


2/3* 


25642 


2.3 


2533 


0.9/3* 


31078 


12 


/3* 


34531 


10.1 


2/3* 


69063 


16.1 


5068 


0.91/3* 


69020 


45.2 


/3* 


75847 


43 


2/3* 


151690 


59.4 


10133 


0.92/3* 


143790 


179 


^* 


156280 


180 


2/3* 


312590 


288 



Table 6.4: Running time T (in seconds) in the case of global completion of general 
n-by-n rectangular matrices of rank d = 2, for various values of m (number of entries 
revealed). 



be easily adjusted to the inner products completion setup. 
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